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Abstract 

A necessary maximum principle is proved for optimal controls of stochastic systems driven by multidimensional 
Teugel's martingales. The multidimensional Teugel's martingales are constructed by orthogonalizing the multidimen- 
sional Levy processes. The control domain need not be convex, and the control is allowed to enter into the terms of 
Teugel's martingales. 
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1. Introduction 

The stochastic maximum principle is one of the central topics in the stochastic optimal control theory. In the past 
four decades, a variety of results have been obtained on optimal stochastic control problems. (cf. for example, [1], [3], 
[5], [12], [14]-[17], [26], [31]). Two major advances in these works are worth mentioning. One is the definition of 
the adjoint processes and its characterization by Ito-type equations. This was contributed by Kushner [17] and Bismut 
[5], and summarized by Bensoussan [3] via functional analysis methods. Another advance is the idea of second-order 
variation in calculating the variation of the cost functional caused by the spike variation of the given optimal control. 
This was motivated by the study of the nonconvex optimal stochastic control of diffusion processes with the control 
entering into the diffusion term, and was developed by Peng [26]. On nonconvex controls of diffusion processes, we 
refer the reader to Kushner [17], Haussmann [14], Bensoussan [3], Hu [15], Hu and Peng [16], Peng [26] and Yong 
and Zhou [35]. 

It is well known that jump-diffusion process is an important class of processes for describing financial data. The 
stochastic maximum principle of jump-diffusion processes, where the control is unallowed into the jump terms, was 
considered by Boel [6], Boel and Varaiya [7], Rishel [28], Davis and Elliott [9] and Situ [31]. The further profound 
problem, where the control enters into the diffusion and jump terms and also some state constrains are imposed, was 
completely solved by Tang and Li [34] by applying the idea of second-order variation. On the convex controls of 
jump-diffusion, we refer the reader to Cadenillas[8], Framstad, Okesendal and Sulem [13], Shi and Wu [30]. 

The Levy process (refers to Bertoin [4], Sato [29]) is a more general class of discontinuous processes than jump- 
diffusion processes. Nualart and Schoutens [22] obtained some interesting results. They introduce the power jump 
processes and the related Teugel's martingales. Furthermore, they give a chaotic and predictable representation for 
a one-dimensional Levy process, in terms of these orthogonalized Teugels martingales. Thus the martingale repre- 
sentation theorem for Levy process satisfying some exponential moment condition was a consequence of the chaotic 
representation. Nualart and Schoutens [23] established the existence and uniqueness of solutions for BSDE driven 
by a one-dimensional Levy process of the kind considered in Nualart and Schoutens [22]. Further progresses on the 
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subject were subsequently given by Bahlali, Eddahbi and Essaky [2], Ren[27], Lin[20]. Based on these Results, a 
stochastic linear-quadratic problem with Levy processes was considered by Mitsui and Tabata [24], Tang and Wu [32]. 
The stochastic maximum principle, where the control enters into the diffusion and jump terms and also control domain 
is convex, was given by Meng and Tang [21], Tang and Zhang [33]. 

Recently, A chaotic and predictable representation theorem associated with multidimensional Levy processes was 
obtained by Lin [19]. This extends the setting in Nualart and Schoutens [22] into the multidimensional Levy processes. 
Furthermore, The existence and uniqueness of solutions for BSDEs driven by multidimensional Teugel's martingales, 
which are constructed by orthogonalizing the multidimensional Levy processes, was proved by Lin [20]. According 
to these results and following the research line of the paper in Peng [26] and Tang and Li [34], this paper discusses 
the general stochastic maximum principle where the control systems are driven by the multidimensional Teugel's 
martingales. It is worth emphasizing that there are three main differences in our setting compared with Mitsui and 
Tabata [24],Tang and Wu [32],Meng and Tang [21] and Tang and Zhang [33]. First, in our paper, the each component 
in stochastic system is driven by a Teugel's martingale which is generated by the multidimensional Levy processes, 
while the each component in stochastic system in [21], [24], [32] and [33] is driven by a Teugel's martingale which 
is generated by one component of multidimensional Levy processes. Secondly, in our paper, the control domain need 
not be convex, while that in Meng and Tang [21], Tang and Zhang [33] is convex and therefore the second-order 
variation technique is unnecessary. Finally, the terminal state in our case is constrained while is not in Meng and Tang 
[21], Tang and Zhang [33]. 

The paper is organized as follows. Section 2 contains an introduction on chaotic and predictable representation 
theorem associated with multidimensional Levy processes and BSDEs driven by multidimensional Teugel's martin- 
gales. In Section 3, we give the statement of the problem, our main assumptions and some preliminary lemmas about 
the first- and second-order variational equation and variational inequality which will be used in the sequel. In Section 
4, we derive the first- and second-order adjoint equations, and finally prove the necessary maximum principle. The 
conclusions are drawn in Section 5. 

2. BSDE driven by multidimensional Teugel's martingales 

A Revalued stochastic process X = {X(t) = (Xi(t),X 2 (t), ■ ■ ■ ,X n (t))',t > 0} defined in complete probability 
space (Q, jF, P) is called Levy process if X has stationary and independent increments and X(0) = 0. A Levy 
process possesses a cadlag modification and we will always assume that we are using this cadlag version. If we let 
& t = %\l JY, where % = cr{X(s), < s < t) is the natural filtration of X, and jY are the P-null sets of then 
{J^r, / > 0} is a right continuous family of cr-fields. We assume that & is generated by X. For an up-to-date and 
comprehensive account of Levy processes we refer the reader to Bertoin [4] and Sato [29]. 

Let X be a Levy process and denote by 

X(t-) = lim X(s), t > 0, 

s— >t,s<t 

the left limit process and by AX(t) = X(t) - X(t-) the jump size at time /. It is known that the law of X(t) is infinitely 
divisible with characteristic function of the form 

E [exp(i0 ■ X(t))] = (4>(ff))' , = (6»i, 2 , • • • , 0„) e W 

where (f>(6) is the characteristic function of X(l). The function if/(0) = logoff) is called the characteristic exponent 
and it satisfies the following famous Levy-Khintchine formula (Bertoin, [4]): 

0(0) = -Ifl • E0 + ia • 6 + \ (exp(ie x)-l-i9- xl w <i) v(dx). 

where a, x e W, 2 is a symmetric nonnegative-definite n x n matrix, and v is a measure on R"\{o] with J(||jc|| 2 A 
l)v(<ij«r) < oo. The measure v is called the Levy measure of X. 

Throughout this paper, we will use the standard multi-index notation. We denote by No the set of nonnegative 
integers. A multi-index is usually denoted by p, p = {p\,pi, ■ ■ ■ ,p„) e NjJ. Whenever p appears with subscript or 
superscript, it means a multi-index. In this spirit, for example, for x = {x\ , • • • , x n ), a monomial in variables x\ , ■ ■ ■ ,x n 



2 



is denoted by x p = x Pl ■ ■ ■ x p " . In addition, we also define p\ = p\\---p n \ and \p\ = p\ + ■ ■ ■ + p n ; and if p, q e W a , 



then we define 6 p , q = 6 Puqi 



In the remaining of the paper, we will suppose that 
Assumption 2.1. the Levy measure satisfies for some s > 0, and A > 0, 



f • 

J|x|>e 



ex/?(i||*||)v((f;c) < oo. 



This implies that 



x p v{dx) < oo. > 2 



and that the characteristic function E [exp(i6 ■ X(t))] is analytic in a neighborhood of origin o. As a consequence, X(t) 
has moments of all orders and the polynomials are dense in L 2 (R", P o X(t)~ l ) for all t > 0. 

Fix a time interval [0, T] and set h\ = L 2 (Q, & T , P). We will denote by 2? the predictable sub-cr-field of & T ® 
&[0,r\- First we introduce some notation: 

• : Let Hi denote the space of square integrable and ^-progressively one-dimensional measurable processes 
4> = {4>(t),te [0,T]} such that 



= E 



Jo 



U(t)\\ 2 dt 



< oo. 



• : Mi. will denote the subspace of Hi formed by predictable processes. 



: (Hj(l 2 )) m and (Mi(l 2 )) m are the corresponding spaces of m-dimensional Z 2 -valued processes equipped with 
the norm 



h\\l 



f (pr 



E 



u d=\ peN> 



k= 1,2, ••• ,m, 



= J]\\Mt)\\ 2 p, 



k=l 



where = (4> u 4> 2 , ■ ■ ■ ,<f> m )', 4>k = : P e NJJ), ifc = 1,2, ■• • ,m andN» = f {peNJ: |/»| = d). 
• : Set -W 2 = Hi x (M 2 (7 2 )) m . 

Following Lin [19] we introduce power jump monomial processes of the form 

\(pi,-,p„) def 



^(M^))" 1 •••(AW", 



0<.s<f 



The number is called the total degree of Furthermore define 

Y (f)<Pi- ^ X(t) (pu -' p " ) - E[X(f) (/ "'"'' / '" ) ] = X{t) (pw -' p " ] - m p t, 

n 

the compensated powerjump process of multi-index/; = (pi,P2,--- ,/?„) where m p = J JT x?'v(dx). Under hypothesis 

1, Y(if Pw " ,p * i is a normal martingale, since for an integrable Levy process Z, the process \Z, - E[Z,],t > 0} is a 
martingale. We call Y(t) (j?l, '" ,Pn) the Teugels martingale monomial of multi-index {p\,- ■ ■ ,p„). 
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We can apply the standard Gram-Schmidt process with the graded lexicographical order to generate a biorthogonal 
basis {H p ,p e N"}, such that each H p (\p\ = d) is a linear combination of the Y q , with \q\ < \p\ and the leading 
coefficient equal to 1 . We set 



YP+ £ c f y + £J> f y, 



where p = {p\, ■ ■ ■ ,p n }, q = \q \ , ■ ■ ■ ,q„] and < represent the relation of graded lexicographical order between two 
multi-indexes. Some details about the technique and theory of orthogonal polynomials of several variables refer to 
DunklandXu [11]. 



Set 



P(x) p 
p(x)P 



xP+ ^ c^+'f^^, 

q<p,\q\=\p\ k=l \q\=k 

\p\-l 



= X P + 



C„X , 



q<p,\q\=\p\ 



k=2 \q\=k 



Set 



( 



H p (t) 



2 (Ax 1 r---(AX„r-+ 2 c 9 (axo« 

q<p,\q\=\p\ 



(AX„)« 



0<s<t 



+ 2 YjCqiAX^ ■■■(AX„)« 
i=l |?|=/c 



-fE 



9<P,I?I=W *=1 l«l=* 



(c ei X!(l) + • • • + C e X„(l)) + 2 



0<.s<r 



-fE 



0<s<( 



-»E[c, 1 X 1 (l) + --- + c,,X II (l)]. 



Specially we have 



H ei (t) 
H e2 (t) 

H e "(t) 



c. 1 (lXX 1 {t)-W.Xi(l))), 

c e2 (2)(X 2 (t) - rl(X 2 (l))) + c e ,{2){X x {i) - fE(Xi(l))), 

c en (n)(X n (t) - tE(X„(l))) + c en _Sn)(X n ^(t) - tE{X n ^{\))) 
+ ■ ■ ■ + c e An){X x {f) - tE{X x {\))). 



(2.1) 



The main tool in the theory of BSDEs is the martingale representation theorem (cf. Pardoux and Peng [25]). 
Nualart and Schoutens [22] had proved the representation theorem associated with one-dimensional Levy process, 
furthermore Nualart and Schoutens [23] had established the existence and uniqueness of solutions for BSDE driven by 
a one-dimensional Teugel's martingale generated by the Levy process. The main results in Lin [19] is the Predictable 
Representation Property (PRP) associated multidimensional Levy processes: 

Lemma 2.1. Every random variable F in L 2 (Q, has a representation of the form 

CO j- 

F = E(F) + 2 2 L <S> p (s)dHP(s) 

d=lpeN>' J " 



where <& p (s) is predictable. This result is an extended version for the corresponding Theorem in Nualart and Schouten 
[22]. 

Taking into account the results and notation presented in the previous section, it seems natural to consider the 
BSDEs with the following form 

oo 

-dY(t) = f{t,Y{t-XZ{t))dt-Y J Yj zP{s)dHP{s) > Y(T ^ = £> W 

d=\ peN" 

where 

. :Y(t) = (Y,(t),Y 2 (t),--- ,Y m (t))'. 

• : Z(f) = {z p (t)}pew , each component z p (t) = (z p , ■ ■ ■ ,z p m )' is a m-variables & t predictable function; 

• f - (fufi, - ■ ■ , fm)' :Ox[0,T]x R m x (m 2 (Z 2 ))'" -> R m is a measurable m-dimensional vector function such 
that/(-,0,0)e (# 2 ) m . 

• / is uniformly Lipschitz in the first two components, i.e., there exists C* > 0, k = 1, 2, • • • , m, such that dt ® dP 
a.s., for all (y u Zi) and <j 2 , Zi) in U m x (f) m 

\fk(t,yuzi) - fk(t,y 2 , z 2 )\ < C k (llji - y 2 h + llzi - z 2 || ( p r ) , k = 1, 2, • • • ,m. 

If (/, satisfies the above assumptions, the pair (/, is said to be standard data for BSDE. A solution of the 
BSDE is a pair of processes, {(Y(t), Z(t)), < t < T] e H\ x (m 2 (/ 2 ))'" such that the following relation holds for all 
K. |().7 |: 

Y(t)=£+ f f(s,Y(s-),Z(s))ds-J]Yj f Z p (s)dH p (s). (2.3) 

A key-result concerning the existence uniqueness of solution of BSDEs (2.2) is given by Lin [20]: 
Lemma 2.2. Given standard data (/, £), there exists a unique solution (Y, Z) which solves the BSDE (2.3) 

3. Notations and preliminary lemmas 

Consider the following stochastic control system: 

OO 

dx(t) = g(x(t-), v(t))dt + X Z y" (x(t -^ v(f))dH'(f), 

d=\ peWj 

x(0) = X Q . (3.1) 

Here and hereafter 

g(x, v) : R m x W -» W, 
y p (x, v) : WT x <U -> WT, V/> e N", 

and 'Z/ is a nonempty subset of M m (control domain). An admissible control v(-) is a ^-predictable process with 
values in U such that 

||v(-)||=: sup [£|v(f)| 8 l" <~ (3.2) 

o<(<r 
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We denote the set of all admissible controls by 0l ad . When OA = R m , we write Lj 8 [[0, 1]; R m ] for 0A ad . The terminal 
constraint is 

EG(xQ,X(T))eQcR k , (3.3) 

where G(; •) =: (G\; •)), ■ • • , G*(-, •) and G'(-, •) : R m x M m -> for ;' = 1,2, •■ ■ ,k. 
The cost functional is 

J(v(-),xq) = E f £(x(t),v(t))dt + Eh(x ,x(T)), (3.4) 
Jo 

where 

£(x, v) : R m x OA -» K, /t(x) : M m -» M. 

Our optimal control problem is to find a pair (yo,u(-)) el"x 1/ a rf such that (3.1) and (3.3) are satisfied and (3.4) is 
minimized 

Throughout the paper, we make the following assumptions 

Assumption 3.1. The vector functions g(x, v), G(y, x),€(x, v),h(y, x) and y p (x, v)(p e Nq) are twice continuously dif- 
ferentiable with respect to x, and G(y, x),h(y, x) are differentiable in y. They and their derivatives in x or y are 
continuous in (x, v) and (y, x).The vector functions g(x, v), G yi (y, x),G Xi (y, x),( x .(x, v),h y .(y, x),h x .(y, x),and 



k= 1,2, 



(i = 1, • • • ,n),are bounded by (1 + \x\ + \y\ + |v|). The vector functions G(y,x),i(x, v),h(y,x) are bounded by (1 + \x\ 2 + 
M 2 + \v\ 2 ),g Xi (x, v),g XiXj (x, v),G XiXj (y, x),{ x . Xj (x, v), h XiXj (y, v),and 

OO oo 

2 2 \z Xi (x,v)\ 2k , k=l,2, YjYj\z p XiXj (x,v)\ 2 

d=\ peN" d d=\ peW d 

(i,j- 1, • • ■ , n)are bounded. Here Xi,yi{i = 1, • ■ ■ ,ri) stand for the ith coordinates of x andy respectively. 

Assumption 3.2. The set Q is closed and convex. 

Let (yo,y(-), «(•)) be an optimal triplet of the problem. For the given (xo, v(-)) el*x Had, write y(-; v(-), xq) for 
the solution of (3.1). For v(-), Vi(-), V2(-) e U a d, denote 

def 

Am(s;v 2 ,vi) = m(y(s-),v 2 ) - m(y(s-),vi), 

def 

Am(s; v) = m(y(s-), v) - m(y(s-), u(s)), 

def v- 5 -- 5 / 

m(s;vi) — m{y{s),v\), 

def 

m(s) — m(y(s), u(s)), 

with m standing for g,y, £ and all their (up to second-) derivatives in x. 

For Io c [0, 1], let |/o| denote the Lebesgue measure of the set Iq. Let v(-), Vi(-), vi(-) £ Had- Define 

^(vi(-). va(O) = f If? e [0, 1]; E\v,{-) - v 2 (-)\ 2 > 0}|. (3.6) 

For p e (0, T],I p c [0, T] and v(-) e H a d, It is classical to construct a perturbed admissible control in the following 
way (spike variation): 

def 

u p (s) = u(s)x[ Q ,i]\i p (s) + v(s)xi p (s), se[0,T], 

f = yo + \I P \ri, /?eM" (3.7) 
/(•) H f y(-,uP(-),f Q ), 



with^A(0 denoting the indicator function of some set A. Obviously, we have 

d{u p (-),u{-)) = \I P \- (3.8) 

We can prove that u p {-) e Had- 

Lemma 3.1. Let the Assumption 3.1 hold. Then for v(-), u(-), u p (-) e 14 ac i 
sup E|y(f;v(0,xo)| 8 = 0((l+||v(-)ll) 8 ), 

t£[0,T] 

sup E\y(t,u(-),yo) -y(t;u p (-),x )\ 4 = 0(d 2 (u p (-), u{-)){\ + IKOII + IK(-)II) 4 ), 

te[0,T] 

sup E\ yi (t,u p (-),u(-))f = 0{d\uP{-\ «(.))(1 + IKOII + IKOII) 8 ), 

<e[0,r] (3.9) 
sup E|y 2 (f;^(-),«(-))| 4 = 0(d\u p (-\ u{-)){\ + \\u{-)\\ + \\uP{-)\\f), 

t€[0,T] 

sup K\y(t; u p , yo + d(ut, u)rj) - y(t;u,yo) - y\ (t; u p ,u)- y 2 (t; u p , u)\ 2 

t£[0,T] 

= o{d\u p {-\ u{-)){\ + IKOII + IKOII) 8 ), as d(u p ( : ), «(•)) -» 0. 
where yi(-), y 2 (-) are the solutions of 

yi(t) = f 8x(y(s),u(s))y 1 (s)ds 
Jo 

+ ZZ [7 P Ay(s),u(s))yi(s) + AyP(s,u p (s),u(s))]dHP(s) (3.10) 
d=l peN" J° 



y 2 (t) = d(u p (-),u(-))T, 



Jo 



g x (y(s), u(s))y 2 (s) + Ag(s, u p (s), u(s)) + ^g xx (y(s), M(s))yi(s)yi(s) 



ds 



j p x (y(s),u(s))y 2 (s) + -y p xx {y{s),u{s))y l {s)yi{s) 



dH p (s) 



d=l peW d 

+ ZZ (3.11) 

w/jere /^yy = 2™. =1 f x > x jy'y j for f = g,yP. 

Proof. Without loss of generality, we assume 77 = 0. Define 

^go(s)dHP(s) =: J^go^//^). VpeN" 

We have the following inequalities for p > 1 : 

E\f f (s)ds P < c p \i p r l Ef \f (sWds, 
1 1 |2 „ " (3.12) 

E\j Ip g (s)dHP(s)\ < C p \I p r l E^\g a (s,z)\ 2 "ds, SpeW. 

By virtue of the Assumption 3. 1, we have 

sup E|y(f)| 8 = 0((1 + ||v(-)|| + IKOII) 8 ), 

te[0,T] 

sup E \Ag(t, u p (s)))\ 4 = 0{{\ + \\u p (-)\\ + IKOII) 4 ), (3 13) 

te[0,T] v ' ' 

sup E \AyP(t; u p (s))f = 0((l + \\u p (-)\\ + IKOII) 8 ), V/> e N". 

te[0,T] 



Then we can obtain the following inequalities by using (3.12): 
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J Q Ag(t, U P(s))) 



= 0(|/ p | 4 (i + ikoii + IMOII) 4 ), 

= 0(|//(1 + ||v(-)ll + IMOII) 8 ), V/» e W. 
Then the first four estimates of (3.9) are easily proved by using the familiar elementary inequalities 

(mi + m 2 y < CQmtf + \m 2 \ l ), i = 4, 8 

and the well-known Gronwall's inequality. 

The proof for the last estimate follows. Set y 3 = y\ + y 2 . We have 

°(y+y 3 ,uP)dHP(s), 



l n \ 



f g(y + y 3 ,uf)ds + Y j J] fy" { 

Jo d=\ peN'- Jo 

= f \g(y, « p ) + g x (y, u p )y 3 + f f '" ! f ■ ">' 

Jo L Jo Jo 

+ Z Z f « p) + ^ uP) yi + f f + ^M m y 3 

ti^fnJO [ JO JO 

I g(y,u)ds+ I g x (y,u)y 3 ds + | Ag(s, u p (s), u(s))ds 
Jo Jo Jo 

+ f &gx(s, u p (s), u(s))y 3 (s)ds + f ifc(y, M)y 3 (i)y3(i)Ji 

Jo Jo z 

mi 
A + ^3, « p ) - fcCy, ")] dAdfj.y 3 y 3 ds 



dH p (s) 



CO „ t oo 

X 2 /(y.«Wi) + HH y£(y,w)y 3 <W(s) 

d=l peNJ ^° rf=l peN^ ^° 

oo , oo ( 

2Z r^y(4«(s)W + XZ Ay^,^),"^)))^^) 
ZZ f irLo^WBW^*) 

°° r' r 1 r 1 

ZZ i^ + ^^O-r?^")]^^^//^. 

tr^Jo Jo Jo 

p ' p (s)dH p (s), 



d=\ pm n d 



is) 



Xt 00 ft 

G p (s)ds + J]J] 
d=l peN" ^° 



(3.14) 
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where 



G"(*) = 2 8xx (y(s) ' M ( s ))0 ; 2(^2(5) + 2 yi (J)y 2 ( J)) 
+A^(y(s), u p (s), u(s))y 2 (s) 

Jo Jo 

Z p ' p (s) = ^W*).«(j))(y2(j)y2(j) + 2yi(j)y2(j)) 



+Ay p x (y(s), u p (s), u(s))y 2 (s) 



Since 



and 



we can derive that 



Xt 00 w 

g(y + y 3 ,« p )^ + 2 X 7 p (y + y3,if)dH p (s) 

G"(s)Js-££ z?<\s)dH\s). 

d=l P eW d Jo 
r-t 00 r-t 

y°(t)=yo+ g(f(s),u p (s))ds + Y V y (/(*), *A*))J//*( S ), 

(/-y-y 3 )(0 = f A'W-y-yaX*)^ 
Jo 

+ 2Z F p '*{s)W-y-yi){s)dH'{s) 

d=\ peW d ^° 

W + XZ * p ' p {s)dH>{s). 
d=\ P &r d Jo 

CO 

\A p (s, a>)\ + V \F p '"(s, a>)\ < C Vj, Vw. 



</=i . 



and 



sup £ 

0<f<r 



r-t 2 00 I _ ( 

+VV ■B p ' p {s)dHP{s) 



2\ 



o(\I p \ 2 (l + ||«P(.)|| + || M (-)II) 8 ). 



From these we can use Ito's formula and Gronwall's inequality to obtain the fifth estimate (3.9). The proof is 
completed. □ 

Lemma 3.2. Assume that l(-) is a scalar-valued Lebesgue integrable function defined on [0, T]. Then for p e (0, T], 
there exists a measurable subset I p C [0, T], such that 



\I P \ = P, 

J If l(s)ds = p J [Q T] l(s)ds + o(p), p -> 0. 

The proof is quite elementary and the reader is referred to [1 8]. 
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(3.15) 



4. Adjoint equations and the maximum principle 

The Hamiltonian is defined as 



H(x, v, A, p, J) = A€{x, v) + (p, g(x, v)) + £ £ (J", y"(x, v)) . 



this is a map from M"'x'MxlxM m x (M 2 {l 2 )) m into R. Here we have used (•, •) for the scalar product of Euclidean 
spaces. 

From Lemma 2.2 and Assumption 3.1, we see for the given p(T) e L 2 (Q., & T \ R m ), P(T) e L 2 {Q., & T ; K mxm ) that 
the Ito-type adjoint equations 



• dp(t) 



g T x (y(t), u(t))p(t) + 2 Z u (0) T J P (t) + MMO, u{t)) 



d=\ , 



dt 



(4.1) 



and 



- dP{f) = 



8 T x (y(t), u(t))P(t) + P(t) 8 Mt), «(0) + £ 2 y?0>«, «(f)) T J P(f)r?(y(0, «(0) 

CO 

h ZZ^ (f) ' M(f))jRP(f) 

</=l peNJ 

oo T 

X Z ^( f )r?(y(0, "(0) + #«CK0, «(0, A, p(o, /«) 



P(7-) = h xx (y(T)) 

admit unique solutions (p(-), {J p (-)} p en») and (P(-), {^ p (0)peN"X with p(-) and P(-) being cadlag processes. 
Define the following function: 

<S>(s,z;s) = f inf Vl f - s \ 2 + ii - z\ 2 

(t,z)e(-°o,J(u(-),y )-e]xQ 

Tang and Li [34] had proved the following result. 



(4.2) 



(4.3) 



A def 



Lemma 4.1. For given s > 0, f/ze function <t>(s,z;e) is continuously differentiable on the open set Q = \(s,z) : 
<D(s,z; s) > 0). Moreover, when 0(i,z; e) > 0, we have 



<® z (s,z;s),z-z> < 0,V2e(2, 
O s (s,z;s) > 0, 
|0^,z;e)| 2 + |<l)^,z; e )| 2 = 1. 



(4.4) 



They introduce the smooth function a(-) defined by 



a(t,z) = 



defj Cexp(t z + \z\ l - 1)-% r + |zr<l, 



0, 



r 2 + kl 2 >i. 
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Choose the constant C such that 

a(t, zjdtdz = 1 . 



f 

JR> 



TRxR* 

Set 

a s (t,z) = S-« + » a (^,f). (4.5) 
They also define the smooth approximation *P(-, •; e, 5) of <!>(•, •; e) as follows: 

*(,,r,M>1?f a>(,-«-,; £ )^,^=l. (4.6) 

JrxR* 

Then it is easy to have 

< ¥(/(«(•), yb),£G(yo,y(r));e, 5) < s+ ^26 
Moreover, Tang and Li [34] gave the following lemma. 
Lemma 4.2. For Q defined in Lemma 4.1, we have for (s, z) e Q, 

lim WJs, z; e, 6) = ® s (s,z;s), 

lim V z (s,c,e,8) = <D z (j, Z ;e). (4.7) 

Our main result in this paper is almost similar to that in Tang and Li [34] in many places: 

Theorem 4.1. Assume Assumptions 3.1 and 3.2 hold. Let (yo, y(-), w(0) be an optimal triplet. Then there exist 

< A e R, n = f {//'}* e R*, 

(p(-), /(•)) 6 4(0, r; K m ) x 4(0, r; (M 2 ,^ 2 ))" 1 ) 

(P(-), /?(•)) e 4(0, T; M mxm ) x 4(0, T; (M 2 (/ 2 )) mxm ) 

smc/z f/zaf we have the following. 
1 ) The nontrivial condition 



|A| 2 + M 2 = 1. (4-8) 



is satisfied. 

2) The Ito-type adjoint equations (4.1), (4. 2), as well as 



' p(T) = Ah x (y Q ,y(T))+ipJG J x (yo,y(T)), 

7=1 

p(0) = -AEh x (y ,y(T))- i^EG J v (y Q ,y(T)) 

7=1 



(4.9) 



and 



p(T) = Ah xx (y Q ,y(T)) + J]p. j G J xx (yo,y(T)), (4.10) 



7=1 

are satisfied, with p(-) and P(-) being cadlag processes. 
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3) The following maximum condition holds: 

H(y(s-), v, A, p(s-), J(s)) - H(y(s-), u(s), A, K(s), J(s)) 



+ \trP(s-) 



2 2 &y p (s;v) 2 2 hyP T (s;v) 

d=\ peN" d=l peN" 



+ \tr 



2 2 R p (s) 

d=\ peN" 



2 2 Ay*(j;v) 2 2 AyP T (s;v) 

d=\ peN" d=l peN" 



(4.11) 



> 0, Vv(-) e U, a.e.a.s.; 
4) The following transversality condition holds: 

<H,z- EG(y , y(T)) >< 0, Vz e Q. 



(4.12) 



Proof 

Step 1. Applying Ekeland's variational principle. We first consider the case that the set U ad is bounded in 

L'Z? [[0, TV M m l; the unbounded case can be reduced to the bounded case. Assume that 

& ,p 



14 a d is bounded in [[0,r];l 



"1 



(4.13) 



An applications of Ekeland's variational principle will lead to the reduction of a general end-constraint problem 
to a family of free end-constraint problems. 
Define the following auxiliary function 

J(v(-), x ; s, 5) = ¥(J(v(-), xo), EG(x , x(T)); e, 6) (4. 14) 

with *P(-, •; s, 6) being defined as in (4.6). Then consider the metric space (R m x U a d, d) with the distance d defined by 

d((x u vi(-)), (x 2 , v 2 (-))) = yjfri -x2\ 2 +d 2 ( Vl (-),v 2 (-)). (4.15) 

Tang and Li [34] verify that *P(-, •; e, S) is complete and J(v(-), xo; s, 6) is continuous and bounded. Also, we have for 
any given s > 0, 



<D(/(v(0, x ), EG(x , x{T)); s) > 0, V(x , v(-)) el"x 1/^; 

O(J(v(-),y ), EG(yo,y(T));s) = s; 

J(v(-), x ; s, S) > 0, V(x , v(-)) e M" 1 x <U ad , 

for sufficiently small 5 > 0; 
J(u(-),y Q ; e,5)<e + 2S + inf (xoA . ))eR n xVad J(v(-), x ; s, 6) 



(4.16) 



Therefore we can apply Ekeland's variational principle (cf.[10]) and conclude that there exist u sd e U ac i and yg' 



such that 



1) J(u Ed (-),yf;s,5) < s + 26; 



2) d((y e Q s , u sS (-)), (y , «(■))) < "ie + 26 

3) /(v(-), x ; e, 5) d = /(v(-), *o; e, 5) + jIT2Sd((x , v(-)), «, « ei (0)) 
> /(«*(■), <), V(x , v(0) € K m x <Z/ ad . 



(4.17) 



Set 



and 



A eS 

e5 



def , 



= ¥,(/(«*(•),;#), £G0f ,y ed CO); e, 5), 
V l Wu a tf,y*),EG(yg,-f s (T)y, s, 6). 



def , 



(4.18) 



y^= f yf e) , ««(-)^ «"*">(■). 
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Tang and Li [34] showed that for each sufficiently small e > 0, we can choose 6(s) > such that A e > and fi B € R k 
satisfy the following: 

lim (\A £ \ 2 + \n e \ 2 ) =1, 

•5-0+ ^ (4.19) 

<M e ,z- EG(y B v y e (T)) > < 6{s) < s. 

Step 2. Computing the first-order component of the cost variation. In this and the next steps, we look for the 
necessary conditions for the minimization of /(v(-), xq; s, S) at (yg, u B (-)). 
For given (77, v(-)) e M m x U ad , set 

u e P(t) = u s (t)x m] \, p (t) + v{t)xi p {t), 

yl p = y s + \I P \T], (4.20) 

y*(.) = y(-,u*f>(-),yl p ). 

We introduce, as in (3.4), the following simplified notations: 

def 

Am B (s;v) = m(y B (s),v)-m(y B (s),u B (s)), 

def \y •*■'■) 

m e {s) = m(y e (s), u B (s)), 

with m standing for g,y, t and all their (up to second-) derivatives in x. 

Lety £p (-) be the solution of (3.1) corresponding to (y^f, u ep (-)). We define, as in (3.9) and (3.10), the half- and 
first-order processes y s (-), ;yf (■)> respectively, by 



y\{i) = f gAy e (s),u B (s))y B (s)ds 
Jo 

+ YjYj\ btty^'^Mis) + A 7 B 'P(s;u B P(s))]dHP(s) (4.22) 



and 



f 2 (t) 

f 

Jo 



g x (y £ (s), u B (s))y B 2 (s) + Ag B (s; u B %s)) + ^g xx (y £ (s), U B (s))y B (s)y B (s) 



ds 



tfifisl^isMis) + iyL(/(*),« e (*M(*MW 



dH p (s) 



J ft 00 r-t 

Ag B (s; u B P( S ))y B (s)ds + V V Ay e /(s, u Bp ( S ))y B (x)dHP(s) + \I p \r, (4.23) 
Tl Jo 



From Lemma 3.1, we can have 



sup £|^(f)| 8 = 0(\I P \ 4 ), 

0<t<T 

sup E\y B 2 (t)\* = 0(|//), 

o<t<T (4.24) 
sup E\f p {f) - /(f) - y\(t) - y B 2 (t)\ 2 = (|/ p | 4 ), 

0<t<T 

as \I p \ — > 0. 



In this step, we are to calculate the first-order component of the cost variation. 
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From 3) in (4.17) of Step 1, we have 



-\I p \^T2s^JTTW 

< J(un-),y ep (Oy,s)-J(u%-),yl;s) 

< A E [J(u^(-),yl + \I p \T ] ) - J(u E (-),y E )] 

m 

+ 2 fi sj [EGj(y s + \l P \ri,y Ep {T)) - EGKy E ,y E {T))] 

7=1 

+0{\J{uV(-\yl + \I p \ n ) - J(u E (-),y E )\ 2 ) 

m 

+ 2 0(\EGKy B a + \i P \v,y sp (T)) - EGKf ,y E (T))\ 2 ) 

7=1 



Using (4.24), we have 



and similarly 



J{u^(-\yl + \I p \r 1 ) - J{u%-\f Q ) 
= |/ p | < Eh y (y E ,y E (T)),r ] > +E < h x (y E ,y E (T)),y E (T) + y E 2 (T) > 
+ \Eyf(T)h xx (yl,y%T))y\{T) 

+E JT 7 e x (y%s),u%s))[y\{s) + y E 2 (s)]ds + \E ' yf(s){ xx (f{s\u E { S ))y\(s)ds 
+E £ A{ B (s, u B P(s))ds + o(\I p \) 



EGKyl + I'pI^CO) - £G"'(y»,y-(r)) 
- |/ p | < EG^fiT))^ > n +E < G J x (y E y y E (T)),y E (T) + y E 2 (T) > 
+ ^Ey ET (T)G J xx (y E ,y E (T))y E (T) + o{\I p \) 



From Lemma 2.2, we see that 
-dp E {t) 



[g T x (y E (t),u E (t))p E (t) 

CO 

+ Z Z ^ £(f) ' » £ (0) T -/ p,£ (0 + W(0, « £ (0) 



rf=l . 



and 



p«(r) = A e ^,/(T)) + 2^G^,/(T)). 

7=1 



-jp s (o = [gj(/(f),« e (f))nf)+nf)^(/(o," £ (0) 

CO CO 

+ Z X r?(y"(0, « e (0) T J P £ (0r?(/(0, «"(0) + Z Z " £ «) T ^ 



d=\ , 



P E (T) = 



+ Z Z ^' £ «r?(/(0, « £ (0) + « £ (0, ^ £ , /AO, AO) 

d=\ peW, 

oo 

d=l peW d 

k 

A. E h xx (y E ,y E (T)) + £f J GLfy%,f(T)). 

7=1 
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have unique solutions (p e (-), {./ p ' e (-) Wj») and (P e (-), {R p ' e (-)} P eN") respectively, with p e (-) and P E (-) being cadlag pro- 
cesses. 

Using Ito's formula, we have from (4.22), (4.28) and (4.29), that 



E <A B h x (y^y B (T)) + Zv ej G j x (f Q ,f(T)) + J Q A e € x {f(s\u e {s)\y\{T)+yl(T)> 

= E<p%T),f 1 (T)+yl(T)> 

= < /AO), n > \I p \ + E J T (p(s), Ag%s, u E P(s)))ds 

CO y 

+ 2 2 Ej (JP(s),A 7 s -P(s, U s P(s)))ds 
+ \E £( P (s),g xx (f(s), u'isW^yKsVds 

CO y 

+ 2 2 ^XV^^^y^^M^i))^^ 



Applying Ito's formula to the matrix-valued processes 

Y(s)=y l (s)y T 1 (s) 



we have 



' y\y\ 



K y\yn 



y\y? ^ 



dY(i) = 



Y(t)g T x (t) + gx (t)Y(t) + £ J] r?(0i-(0r?(0 T + <*> £ (0 



d=\ peN" 



dt 



+ Z Z [ y «^ f ) T + r?(0i-(0 + fi*"(fl] dff'(0 



(4.30) 



(4.31) 



d=l 



where 



<D e (f) 



n p ' e (f) 



X Z r?(0yi(f)Ar J '(f," £ (f)) T + Z Z Ar p (f,« £ (0)yi(r) r r?(0 T 



d=\ 



+ X Z ^('.""(0)Z 2 A^(f,« £ ( f )) T 

d=l peNJ rf=l peNJ 

yi(f)Ar P (f, u E {t)) T + Ay p (t, u e (t)) yi (t) T 

CO CO 

+ Z Z Ar p (f,« £ (0)Xi Z "W 



d=i. 



d=\. 
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and 



A B Ey B { 1 (T)h xx (y B ,y B (T))y B (T) + 2 fWft 1 (T)G J xx (y B ,y B (T))yl(T) 
= trE[P s {T)y\{T)yf{T)] 



2 2 Ay^s; « £ "(s)) 2 2 Ay"* T (j; m £ "(s)) 

rf=l peW d d=\ peW d 



-E j Q y B { T (s)H xx (y B (s),u B (s),A B ,p B (s),J B (s))y B (s)ds 
+E £trP°(s) 

+ E fo tr 
+2E ^ trP £ (s) 



ds 



2 2 R**{.s) 

d=\ peW 



2 2 Ay^s; w £ "(s)) 2 2 Ay 8 *" 1 "^; u B P(s)) 

d=\ peNj d 



ds 



2 2 yJ p (*)y £ WAy^ T (*;w^)) 

d=\peW. 



ds 



Noting the estimates (4.24), we conclude from (4.25)-(4.27) and (4.30)-(4.32) that 



(4.32) 



E < A B h y (y B ,y B (T)) + 2 p ej G J y (y B ,y B (T) + p £ (0), r, > \I p \ 

7=1 

+ JT J l B (s, u E P)ds + o(|/ p |) > -\I p \ ^Js + 2S(s)^JTTW 

where l B (-; v) is defined by 

l B (s; v) =: E (H(y(s), u B (s), A, p(s), J(s)) - H(y(s), u(s), A, p(s), /(*))) 
+^£frP £ (s) 



2 2 Ay*' (s; m £ "(s)) 2 2 Ay^ T (s; ^(s)) 
d=l peNJ d=\ peN d 



\Etr 



2 2 R e '"(s) 

d=\ psN" 



2 2 Ay^(s; M £ "(s)) 2 2 Af-f-^s; u B P(s)) 

d=\ peW d d=\ peW d 



(4.33) 



(4.34) 



Step 3. Differentiability. For given v(-) e Hod, applying Lemma 3.2 to the real valued Lebesgue integrable 
function, we know that there exists I p c [0, T] such that 



\I P \ = P, 

J r £ B (s, v(s))ds = p jT r £ B (s; v(s))ds + o(p), as p ^ 



Next choose the above I p in (4.20), and we have 



f { B (s,v(s))ds = p f e(s;u sp (s))ds 
J/„ Jo 



From (4.33)-(4.36), we conclude for given v(-) e Had that 

E < A B h y (f Q , y»(D) + 2 ^'^(yg, /CO + p £ (0), n>P+p£ ns, v{s))ds 



7=1 



Hence 



> -p Ve + 25(e) Vl + M 2 + o(p), as p -> 0. 



£ < ^(y^/CO) + 2 p Bj G J y (y B ,y B (T) + p B (0), n>+£ ( B (s, v(s))ds 

7=1 



This implies that 



> - Ve + 26(e) Vl + M 2 , Vt? 6 R™ Vv(-) e 1/^. 



A^Gfry^r)) + 2 n Bj EG } y (y E Q ,y B (T) + p B (0) < C V3e", 

7=1 

/ o r ^"(5, v(i))Ji > - Ve + 25(e), Vv(-) e 1/^. 
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(4.35) 



(4.36) 



(4.37) 



(4.38) 



(4.39) 



Step 4. Passing to the limit. Without loss of generality, we assume that A e — > A, \f — > yu, as s — > 0+. 
Let e -> 0+. Equation (4.19)2 gives the following: 



E g (H(y(s), u%s), A, p(s), J(s)) - H(y(s), u(s), A, p(s), J(s)))ds^ 
+ \E£trP%s) 



tr 



2 2 Ay £ 'P( S ;u e P(s)) 2 2 Ay»* T (j; 

it r 



2 2 R e - P (s) 

> 0, Vv(-) e U ad ; 



2 2 Ay^s; m £ "(s)) 2 2 Ay* T (j; m £ "(s)) 

<f=l peN^ </=! peN n d 



ds 



(4.40) 



this implies (4.11). Furthermore, (4.11) is obtained from (4.19)i, (4.9)2 is obtained from (4.39)i, and the rest of 
Theorem 4.1 is checked from (4.28) and (4.29). 

Step 5. The unbounded case of1i a d in L^ 8 [[0, T]; R m ].The proof procedure is the same as the step 5 in Tang and 
Li [34]. ' 

The proof of Theorem 4. 1 is complete. □ 



5. Conclusions 

In this paper, necessary maximum principle for optimal control of stochastic system driven by multidimensional 
Teugel's martingales is proved, where the multidimensional Teugel's martingales are constructed by orthogonalizing 
the multidimensional Levy processes. The control variable is allowed to enter the coefficients of the Teugel's mar- 
tingales, and the control domain is nonconcave. The technique for proving the maximum principle and the obtained 
result are almost similar to Peng [26] and Tang and Li [34]. 



References 

[1] J.S.Bras,R.J.Elliott,M.Kohlmann, The partially observed stochastic minimum principle. SIAM J. Control Optim.. 27 (1989) 1279-1292. 
[2] K.Bahlali,M.Eddahbi,E.Essaky, BSDE associated with Levy processes and application to PDIE. Journal of Applied Mathematics and Stochas- 
tic Analysis. 16(1)) (2003) 1-17 . 

[3] A.Bensoussan, Lectures on Stochastic Control, in Nonlinear Filtering and Stochastic Control.Lecture Notes in Mathematics 972, Proceed- 

ings.Cortona, Springer- Verlag,Berlin,New York, 1981. 
[4] J.S.E.Bertoin, Levy processes . Cambridge University Press,Cambridge,1996. 

[5] J.M.Bismut, An introductory approach to duality in optimal stochastic control. SIAM Rev. 20 (1978) 62-78. 

[6] R.K.Boel, Optimal control of jump processes.E/ecrrora'cs Research Lab. Memo M448, University of California, Berkeley, CA, July 1974. 
[7] R.K.Boel.P.Varaiya, Optimal control of jump processes. SIAM J. Control Optim.. 15 (1977) 92-119. 

[8] A.Cadenillas, A stochastic maximum principle for systems with jumps, with applications to finance. Systems and Control Letters. 47 (2002) 
433^444. 

[9] M.Davis, R.Elliott, Optimal control of jump processes. Z. Wahrscheinlichkeitstheorieverw. Gebiete. 40 (1977) 183-202. 
[10] I.Ekeland, Nonconvex minimization problems,Br<ZZ. Amer. Math. Soc.(NS). 1 (1979) 443-474. 

[11] C.F.Dunkl,Y. Xu, Orthogonal Polynomials of Several Variables. Encyclopedia of Mathematics and its Applications 81, Cambridge University 
Press, Cambridge, 2001. 

[12] W.H.Fleming, Optimal continuous-parameter stochastic control. SIAM Rev. 11 (1969) 470-509. 

[13] N.C.Framstad,B.0ksendal,A.Sulem, Sufficient stochastic maximum principle for the optimal control of jump diffusions and applications to 

finance. Journal of Optimization Theory and Applications. 1 (2004) 77-98. 
[14] U.G.Haussmann, The maximum principle for optimal control of diffusions with partial information. SIAM J. Control Optim.. 25 (1987) 

341-361. 

[15] Y.Hu, Maximum principle of optimal control for Markov processes. Acta Mathematica Sinica. 33 (1990) 43-56. 

[16] Y.Hu,S.Peng, Maximum principle for semilinear stochastic evolution control systems. Stochastics Stochastics Rep. .33 (1990) 159-180. 

[17] HJ.Kushner, Necessary conditions for continuous parameter stochastic optimization problems. SIAM J. Control. 10 (1972) 550-565. 

[18] X.Li.Y.Yao, Maximum principle of distributed parameter systems with time lags, Distributed Parameter Systems, Lecture Notes in Control 

and Information Sciences, 75, Springer- Verlag, New York, (1985) 410^127. 
[19] J.Z.Lin, Chaotic and predictable representations for multidimensional Levy processes, http://arxiv.org, arXiv:1111.0124, 2011. 
[20] J.Z.Lin, Backward stochastic differential equations and Feynman-Kac formula for multidimensional Levy processes, with applications in 

Finance, http://arxiv.org, arXiv:1201.6614, 2012. 
[21] Q.X.Meng.M.N.Tang, Necessary and sufficient conditions for optimal control of stochastic systems associated with Levy processes. Science 

in China Series F: Information Sciences. 52(2009) 1982-1992. 



17 



[22] D.Nualart.W.Schoutens, Chaotic and predictable representations for Levy processes. Stochastic Processes and their Applications. 90) (2000) 
109-122. 

[23] D.Nualart.W.Schoutens, BSDE's and Feynman-Kac Formula for levy processes with applications in finance. Bernoulli. 7) (2001) 761-776. 
[24] K.Mitsui,Y.Tabata, A stochastic linear-quadratic problem with Levy processes and its application to finance. Stochastic Processes and their 

Applications. 118 (2008) 120-152. 
[25] E.Pardoux.S.Peng, Adapted Solution of a Backward stochastic differential equation. Systems and Control Letters. 14 (1990) 55-61. 
[26] S.Peng, A general stochastic maximum principle for optimal control problems. SIAM J. Control and Optimization. 28(4) (1990) 966-979. 
[27] Y.Ren, Refelected backward stochastic differential equations driven by a Levy process. ANZIAM J. 50 (2009) 486-500. 
[28] R.Rishel, A minimum principle for controlled jump processes. Lecture Notes in Economics and Mathematical Systems. 107 (1975) 493-508. 

Springer- Verlag, Berlin, Heidelberg, New York. 
[29] K.Sato, Levy processes and infinitely divisible distributions . Cambridge University Studies in Advanced Mathematics, Vol. 68. Cambridge 

University Press, Cambridge, 1999. 

[30] J.Shi,Z.Wu, Maximum principle for forward-backward stochastic control system with random jumps and applications to finance. J Syst Sci 
Complex. 2010 (2010) 219-231. 

[31] R.Situ, A maximum principle for optimal controls of stochastic systems with random jumps. Proc. National Conference on Control Theory 

and Its Applications. Qingdao, Shandong, PRC, 1991. 
[32] H.Tang.Z.Wu, Stochastic differential equations and stochastic linear quadratic optimal control problem with Levy processes. / Syst Sci 

Complex. 22 (2009) 122-136. 

[33] M.N. Tang, Q.Zhang, Optimal variational principle for backward stochastic control systems associated with Levy processes. Science China- 
Mathematics. 55(4) (2012) 745-761. 

[34] S.J.Tang.X.J.Li, Necessary conditions for optimal control of stochastic systems with random jumps. SIAM J. Control and Optimization. 32(5) 
(1994) 1447-1475. 

[35] J.Yong,X.Zhou, Stochastic Controls :Hamiltonian Systems andHJB Equations . Springer, New York, 1999. 



18 



